Metrics for Saliency Map Evaluation of Deep Learning Explanation Methods

نویسندگان

چکیده

Due to the black-box nature of deep learning models, there is a recent development solutions for visual explanations CNNs. Given high cost user studies, metrics are necessary compare and evaluate these different methods. In this paper, we critically analyze Deletion Area Under Curve (DAUC) Insertion (IAUC) proposed by Petsiuk et al. (2018). These were designed faithfulness saliency maps generated generic methods such as Grad-CAM or RISE. First, show that actual score values given map ignored only ranking scores taken into account. This shows insufficient themselves, appearance can change significantly without being modified. Secondly, argue during computation DAUC IAUC, model presented with images out training distribution which might lead unexpected behavior explained. To complement DAUC/IAUC, propose new quantify sparsity calibration explanation methods, two previously unstudied properties. Finally, give general remarks about studied in paper discuss how them study.

برای دانلود رایگان متن کامل این مقاله و بیش از 32 میلیون مقاله دیگر ابتدا ثبت نام کنید

اگر عضو سایت هستید لطفا وارد حساب کاربری خود شوید

منابع مشابه

Explanation Methods in Deep Learning: Users, Values, Concerns and Challenges

Issues regarding explainable AI involve four components: users, laws & regulations, explanations and algorithms. Together these components provide a context in which explanation methods can be evaluated regarding their adequacy. The goal of this chapter is to bridge the gap between expert users and lay users. Different kinds of users are identified and their concerns revealed, relevant statemen...

متن کامل

Evaluation of Deep Reinforcement Learning Methods for Modular Robots

We propose a novel framework for Deep Reinforcement Learning (DRL) in modular robotics using traditional robotic tools that extend state-of-the-art DRL implementations and provide an end-to-end approach which trains a robot directly from joint states. Moreover, we present a novel technique to transfer these DLR methods into the real robot, aiming to close the simulation-reality gap. We demonstr...

متن کامل

Deep Learning for Saliency Prediction in Natural Video

The purpose of this paper is the detection of salient areas in natural video by using the new deep learning techniques. Salient patches in video frames are predicted first. Then the predicted visual fixation maps are built upon them. We design the deep architecture on the basis of CaffeNet implemented with Caffe toolkit. We show that changing the way of data selection for optimisation of networ...

متن کامل

Deep Learning for Object Saliency Detection and Image Segmentation

In this paper, we propose several novel deep learning methods for object saliency detection based on the powerful convolutional neural networks. In our approach, we use a gradient descent method to iteratively modify an input image based on the pixel-wise gradients to reduce a cost function measuring the class-specific objectness of the image. The pixel-wise gradients can be efficiently compute...

متن کامل

ذخیره در منابع من


  با ذخیره ی این منبع در منابع من، دسترسی به آن را برای استفاده های بعدی آسان تر کنید

ژورنال

عنوان ژورنال: Lecture Notes in Computer Science

سال: 2022

ISSN: ['1611-3349', '0302-9743']

DOI: https://doi.org/10.1007/978-3-031-09037-0_8